COVID-19 Impact on Family Medicine Residents Exam Performance.

BACKGROUND AND OBJECTIVES: The COVID-19 pandemic began interrupting family medicine residency training in spring 2020. While a decline in scores on the American Board of Family Medicine In-Training Examination (ITE) has been observed, whether this decline has translated into the high-stakes Family Medicine Certification Examination (FMCE) is unclear. The goal of this study was to systematically assess the magnitude of COVID-19 impact on medical knowledge acquisition during residency, as measured by the ITE and FMCE. METHODS: A total of 19,101 initial certification candidates from 2017 to 2022 were included in this study. Annual ITE scores and FMCE scores were reported on the same scale (200-800) and served as the outcome measure. We conducted multilevel regression analysis to determine ITE score growth and FMCE scores compared to cohorts prior to COVID-19. RESULTS: During COVID-19, the increase in ITE scores from postgraduate year 2 (PGY-2) to PGY-3 was 25.5 points less, representing a 57.6% relative decrease; and from PGY-3 ITE to FMCE, it was 8.6 points less, a 12.7% relative decrease, compared with cohorts prior to COVID-19. FMCE scores were 6.6 points less during COVID-19, representing a 1.2% relative decline from the average FMCE score prior to COVID-19. CONCLUSIONS: This study found nonsubstantive COVID-19 impact on FMCE scores, but a considerable knowledge acquisition decline during residency, especially during the PGY-2 to PGY-3 period. While COVID-19 impacted learning, our findings indicated that residencies were largely able to remediate knowledge deficits before residents took the FMCE.

Physician-Level Continuity of Care and Patient Outcomes in All-Payer Claims Database.

INTRODUCTION: Being one of the few existing measures of primary care functions, physician-level continuity of care (Phy-CoC) is measured by the weighted average of patient continuity scores. Compared with the well-researched patient-level continuity, Phy-CoC is a new instrument with limited evidence from Medicare beneficiaries. This study aimed to expand the patient sample to include patients of all ages and all types of insurance and reassess the associations between full panel-based Phy-CoC scores and patient outcomes. METHODS: Cross-sectional analysis at patient-level using Virginia All-Payer Claims Database (VA-APCD). Phy-CoC scores were calculated by averaging patient's Bice-Boxerman Index scores and weighted by the total number of visits. Patient outcomes included total cost and preventable hospitalization. RESULTS: In a sample of 1.6 million Virginians, patients who lived in rural areas or had Medicare as primary insurance were more likely to be attributed to physicians with the highest Phy-CoC scores. Across all adult patient populations, we found that being attributed to physicians with higher Phy-CoC was associated with 7%-11.8% higher total costs, but was not associated with the odds of preventable hospitalization. Results from models with interactions revealed nuanced associations between Phy-CoC and total cost with patient's age and comorbidity, insurance payer, and the specialty of their physician. CONCLUSIONS: In this comprehensive examination of Phy-CoC using all populations from the VA-APCD, we found an overall positive association of higher full panel-based Phy-CoC with total cost, but a non-significant association with the risk of preventable hospitalization. Achieving higher full panel-based Phy-CoC may have unintended cost implications.

Growing a rural family physician workforce: The contributions of rural background and rural place of residency training.

OBJECTIVE: To determine the distinct influences of rural background and rural residency training on rural practice choice among family physicians. DATA SOURCES AND STUDY SETTING: We used a subset of The RTT Collaborative rural residency list and longitudinal data on family physicians from the American Board of Family Medicine National Graduate Survey (NGS; three cohorts, 2016-2018) and American Medical College Application Service (AMCAS). STUDY DESIGN: We conducted a logistic regression, computing predictive marginals to assess associations of background and residency location with physician practice location 3 years post-residency. DATA COLLECTION/EXTRACTION METHODS: We merged NGS data with residency type-rural or urban-and practice location with AMCAS data on rural background. PRINCIPAL FINDINGS: Family physicians from a rural background were more likely to choose rural practice (39.2%, 95% CI = 35.8, 42.5) than those from an urban background (13.8%, 95% CI = 12.5, 15.0); 50.9% (95% CI = 43.0, 58.8) of trainees in rural residencies chose rural practice, compared with 18.0% (95% CI = 16.8, 19.2) of urban trainees. CONCLUSIONS: Increasing rural programs for training residents from both rural and urban backgrounds, as well as recruiting more rural students to medical education, could increase the number of rural family physicians.

Addressing Social Determinants of Health in Family Medicine Practices.

Primary care practices are under pressure to address patients' social determinants of health (SDOH). However, the extent to which these practices have this ability remains unknown. The objective of this study was to examine the association between physician, practice, and community characteristics and the ability of family medicine practices to address patients' SDOH. This cross-sectional study used data from the American Board of Family Medicine Continuing Certification Questionnaire from 2017 to 2019, with a 100% response rate. Respondents rated their practice's ability to address SDOH, which was dichotomized as high or low. Sequential multivariate logistic regression determined the association of the reported ability to address SDOH with physician, practice, and community characteristics. Among 19,300 respondents, 55.6% reported a high ability to address patients' SDOH. Across models controlling for different groups of variables, characteristics persistently positively associated with ability to address SDOH included employment at a federally qualified health center (Odds Ratios [OR] = 2.111-3.012), federally funded clinic (OR = 1.999-2.897), managed care organization (OR = 2.038-2.303), and working collaboratively with a social worker (OR = 2.000-2.523) or care coordinator (OR = 1.482-1.681). Characteristics persistently negatively associated with the ability to address SDOH were practicing at an independently owned (OR = 0.726-0.812) or small practice (OR = 0.512-0.863). While results varied across models, these findings are important for developing evidence-based policies and recommendations for resource sharing and allocation in clinics and communities. Ensuring availability and access to allied health professionals and community resources may be key components in Family Medicine clinics addressing SDOH.

Variation in Practice Patterns of Early- and Later-Career Family Physicians.

INTRODUCTION: Understanding how physicians' practice patterns change over a career is important for workforce and medical education planning. This study examined trends in self-reported practice activity among early- and later-career stage family physicians (FPs). METHODS: Data on early career FPs came from the American Board of Family Medicine's National Graduate Survey (NGS) and on later career FPs from its Continuous Certification Questionnaire (CCQ). Both cohorts could complete the Practice Demographic Survey (PDS) 3 years later. Longitudinal cohorts were from 2016 to 2019 and 2017 to 2020, respectively. All surveys included identical items on scope of practice, practice type, organization, and location. We characterized physicians as outpatient continuity only, outpatient and inpatient care (mixed practice), and no outpatient continuity (for example, hospitalist). We conducted repeated cross-sectional and longitudinal analysis of practice type. RESULTS: Our sample included 8,492 NGS and 30,491 CCQ FPs. In both groups, the vast majority provided outpatient continuity of care (77% to 81%). Approximately 25% of NGS had a mixed practice compared with approximately 16% of the CCQ group. The percent of FPs who had a mixed practice declined in both groups (34.21% to 27.10% and 23.88% to 19.33%). In both groups, physicians with higher odds of leaving mixed practice were in metropolitan counties or changed practice types. CONCLUSION: Although early-career FPs more frequently reported providing both inpatient and outpatient care and serving as hospitalists compared with later-career FPs, both groups had a decline in frequency of providing mixed practice. This change after only 3 years in practice has significant implications for patient care and medical education.

Early-Career Compensation Trends Among Family Physicians.

PURPOSE: Family medicine incomes are often cited as a key reason for shortages of family physicians. The purpose of this study was to identify family physician income trends and to test how income varies among early-career family physicians. METHODS: We used data from the 2016 to 2020 American Board of Family Medicine National Graduate Survey (NGS) collected from early-career family physicians (n = 9566; response rate = 63.9%). The NGS asked practice income, practice activities, practice site, and setting. We performed an income trend analysis and conducted multivariate regression to test for associations of personal and workplace characteristics with income. RESULTS: Average income across the full sample of early-career family physicians (after inflation adjustments) was $224,292. Overall, income growth outpaced inflation from 2016 to 2020. There are significant differences in income based on personal and work characteristics, and income growth varied dramatically. Notably, women respondents reported earnings of $33,522 below those of men respondents in adjusted models. In addition, the incomes of several groups lagged behind inflation, including those practicing geriatrics (-0.67%), employed by the Indian Health Service (-1.72%), and respondents who identified as Black or African American (-0.85%). Greatest increases in inflation-adjusted incomes were observed among those in palliative care (4.61%) and at nonfederal government clinics (4.46%). CONCLUSIONS: Though income is only one factor physicians consider in deciding where and how to work, it is concerning to see lower incomes among groups that traditionally experience shortages (eg, geriatrics and government-associated practice sites). Differences in expected income among family physicians choosing different work may exacerbate workforce challenges.

Research interests of family physicians applying for research training.

BACKGROUND: There is an ongoing need for research to support the practice of high quality family medicine. The Family Medicine Discovers Rapid Cycle Scientific Discovery and Innovation (FMD RapSDI) program is designed to build capacity for family medicine scientific discovery and innovation in the United States. Our objective was to describe the applicants and research questions submitted to the RapSDI program in 2019 and 2020. METHODS: Descriptive analysis for applicant characteristics and rapid qualitative analysis using principles of grounded theory and content analysis to examine the research questions and associated themes. We examined differences by year of application submission and the applicant's career stage. RESULTS: Sixty-five family physicians submitted 70 applications to the RapSDI program; 45 in 2019 and 25 in 2020. 41% of applicants were in practice for five years or less (n = 27), 18% (n = 12) were in in practice 6-10 years, and 40% (n = 26) were ≥ 11 years in practice. With significant diversity in questions, the most common themes were studies of new innovations (n = 20, 28%), interventions to reduce cost (n = 20, 28%), improving screening or diagnosis (n = 19, 27%), ways to address mental or behavioral health (n = 18, 26%), and improving care for vulnerable populations (n = 18, 26%). CONCLUSION: Applicants proposed a range of research questions and described why family medicine is optimally suited to address the questions. Applicants had a desire to develop knowledge to help other family physicians, their patients, and their communities. Findings from this study can help inform other family medicine research capacity building initiatives.

Impact of Service-Based Student Loan Repayment Program on the Primary Care Workforce.

PURPOSE: As the average level of medical education indebtedness rises, physicians look to programs such as Public Service Loan Forgiveness (PSLF) and National Health Service Corps (NHSC) to manage debt burden. Both represent service-dependent loan repayment programs, but the requirements and program outcomes diverge, and assessing the relative uptake of each program may help to inform health workforce policy decisions. We sought to describe variation in the composition of repayment program participant groups and measure relative impact on patient access to care. METHODS: In this bivariate analysis, we analyzed data from 10,677 respondents to the American Board of Family Medicine's National Graduate Survey to study differences in loan repayment program uptake as well as the unique participant demographics, scope of practice, and likelihood of practicing with a medically underserved or rural population in each program cohort. RESULTS: The rate of PSLF uptake tripled between 2016 and 2020, from 7% to 22% of early career family physicians, while NHSC uptake remained static at 4% to 5%. Family physicians reporting NHSC assistance were more likely than those reporting PSLF assistance to come from underrepresented groups, demonstrated a broader scope of practice, and were more likely to practice in rural areas (23.3% vs 10.8%) or whole-county Health Professional Shortage Areas (12.5% vs 3.7%) and with medically underserved populations (82.2% vs 24.2%). CONCLUSIONS: Although PSLF supports family physicians intending to work in public service, their peers who choose NHSC are much more likely to work in underserved settings. Our findings may prompt a review of the goals of service loan forgiveness programs with potential to better serve health workforce needs.

Colorectal Cancer Screening in Rural and Urban Primary Care Practices Amid Implementation of the Medicare Access and CHIP Reauthorization Act.

PURPOSE: The Medicare Access and CHIP Reauthorization Act (MACRA) incentivized primary care practices to improve colorectal cancer screening rates. This study examined if colorectal screening rates improved among rural and urban primary care practices amid implementation of MACRA. METHODS: Colorectal cancer screening data are from a national registry of 139 primary care practices. Repeated measures regression tested for rural/urban differences and changes in screening rates between 2016 and 2020, adjusting for county demographic factors and social deprivation. RESULTS: Screening rates were 64% in both rural and urban practices in the first quarter of 2016 and increased to 80% and 83% in rural and urban practices, respectively, in the last quarter of 2020. In adjusted analyses, screening rates increased by 4% per year and there were no rural/urban differences. Lower screening rates were associated with higher county proportions of persons who were 45 to 74 years of age and Hispanic. Higher screening rates were associated with higher county proportions of persons who were White, Black, and Asian and higher social deprivation. CONCLUSIONS: Colorectal screening rates improved among rural and urban primary care practices during implementation of MACRA, but disparities persist among practices serving county populations that are relatively older, more Hispanic, and have higher social deprivation.

Maternity Access in Rural America: The Role of Family Physicians in Providing Access to Cesarean Sections.

INTRODUCTION: As an increasing number of rural hospitals close their maternity care units, many of the approximately 28 million reproductive-age women living in rural America do not have local access to obstetric services. We sought to describe the characteristics and distribution of cesarean section-providing family physicians who may provide critical services in maintaining obstetric access in rural hospitals. METHODS: Using a cross-sectional study design, we linked data from the 2017 to 2022 American Board of Family Medicine's Continuting Certification Questionnaire on provision of cesarean sections as primary surgeon and practice characteristics to geographic data. Logistic regression determined associations with provision of cesarean sections. RESULTS: Of 28,526 family physicians, 589 (2.1%) provided cesarean sections as primary surgeon. Those who provided cesarean sections were more likely to be male (odds ratio (OR) = 1.573, 95% confidence limits (CL) 1.246-1.986), and work in rural health clinics (OR = 2.157, CL 1.397-3.330), small rural counties (OR = 4.038, CL 1.887-8.642), and in counties without obstetrician/gynecologists (OR = 2.163, CL 1.440-3.250). DISCUSSION: Although few in number, family physicians who provide cesarean sections as primary surgeon disproportionately serve rural communities and counties without obstetrician/gynecologists, suggesting that they provide access to obstetric services in these communities. Policies that support family physician training in cesarean sections and facilitate credentialing of trained family physicians could reverse the trend of closing obstetric units in rural communities and reduce disparities in maternal and infant health outcomes.

A Comparative Effectiveness Study on Opioid Use Disorder Prediction Using Artificial Intelligence and Existing Risk Models.

Opioid use disorder (OUD) is a leading cause of death in the United States placing a tremendous burden on patients, their families, and health care systems. Artificial intelligence (AI) can be harnessed with available healthcare data to produce automated OUD prediction tools. In this retrospective study, we developed AI based models for OUD prediction and showed that AI can predict OUD more effectively than existing clinical tools including the unweighted opioid risk tool (ORT). Data include 474,208 patients' data over 10 years; 269,748 were females with an average age of 56.78 years. Cases are prescription opioid users with at least one diagnosis of OUD or at least one prescription for buprenorphine or methadone. Controls are prescription opioid users with no OUD diagnoses or buprenorphine or methadone prescriptions. On 100 randomly selected test sets including 47,396 patients, our proposed transformer-based AI model can predict OUD more efficiently (AUC = 0.742 ± 0.021) compared to logistic regression (AUC = 0.651 ± 0.025), random forest (AUC = 0.679 ± 0.026), xgboost (AUC = 0.690 ± 0.027), long short-term memory model (AUC = 0.706 ± 0.026), transformer (AUC = 0.725 ± 0.024), and unweighted ORT model (AUC = 0.559 ± 0.025). Our results show that embedding AI algorithms into clinical care may assist clinicians in risk stratification and management of patients receiving opioid therapy.

Characteristics of Family Physicians Practicing Collaboratively With Behavioral Health Professionals.

Integrating behavioral health into primary care can improve access to behavioral health and patient health outcomes. We used 2017-2021 American Board of Family Medicine continuing certificate examination registration questionnaire responses to determine the characteristics of family physicians who work collaboratively with behavioral health professionals. With a 100% response rate, 38.8% of 25,222 family physicians reported working collaboratively with behavioral health professionals, with those working in independently owned practices and in the South having substantially lower rates. Future research exploring these differences could help develop strategies to support family physicians implement integrated behavioral health to improve care for patients in these communities.

The Association of Practice Type and the Scope of Care of Family Physicians.

INTRODUCTION: Comprehensiveness is a defining principle of primary care and Family Medicine but is declining in some settings. This study explores the relationship between practice setting and comprehensiveness among family physicians (FPs). METHODS: Using 2014 to 2016 American Board of Family Medicine survey data to generate scope of practice (SOP) scores (0 to 30) for FPs. We ran univariate and bivariate analyses for services by practice organization type. Our principal independent variable was practice organization type and dependent variable, the SOP score. RESULTS: Among 25,117 total respondents, FPs at rural health centers (RHC) had the widest scope of practice (SOP score of 17.7) whereas FPs in federal, urgent care and other safety net clinics had the narrowest with mean SOP score of 14.0 or less. Higher rates of FPs practicing in Federally Qualified Health Centers and academic health centers were providing a women's health service, except for deliveries, whereas FPs in rural health centers were providing obstetric services (24%). The proportion of FPs providing newborn care was highest in RHCs and lowest in the urgent care setting (85%, vs 26%). A higher proportion of FPs in RHCs provided joint injections and skin procedures than FPs in other practice organizations. CONCLUSIONS: Significant variation in FP comprehensiveness exists across different practice types. FPs in practice types commonly associated with large health systems had narrower breadth of practice, concerning amid increasing practice consolidation. Given associations between comprehensiveness and desirable health care outcomes, policy makers should encourage payment/accountability models that incentivize broader SOP.

Pandemic Disruption in Residency Did Not Alter Trends in Intended Scope of Practice.

We found the intended scope of practice remained unchanged in graduating family medicine residents between pre-pandemic and pandemic period. Tracking these trends with later cohorts will fully assess the pandemics' impact on training so that residencies can adjust their education accordingly.

Evaluating the Teaching Health Center Graduate Medical Education Model at 10 Years: Practice-Based Outcomes and Opportunities.

Background: Since 2011, the Teaching Health Center Graduate Medical Education (THC GME) program has sought to expand access to care by training residents in safety net settings. Objective: To examine impact on physician scope, location, and patient population served using a unique data set. Methods: Using 2017-2020 data from the American Board of Family Medicine National Graduate Survey, we compared demographics, practice location, populations served, and scope of practice between graduates of THC GME programs and graduates of other family medicine programs. Results: Our sample comprised 8608 (out of 13 465) eligible family medicine graduates 3 years after completion of residency training, for a response rate of 63.9%. THC graduates were significantly more likely than other graduates to practice in a rural location (17.9% to 11.8%), within 5 miles of their residency program (18.9% to 12.9%), and to care for medically underserved populations (35.2% to 18.6%). Their scope of practice was wider than other graduates and more likely to comprise services like buprenorphine prescribing, behavioral health care, and outpatient gynecological procedures. Regression results suggest that THC training is independently correlated with a broader scope of practice. Conclusions: Graduates of THC programs were significantly more likely than graduates of other programs to practice close to their training sites and in rural areas, and to care for underserved patients while maintaining a broader scope of practice than other graduates.

Relationship Between Physician Burnout And The Quality And Cost Of Care For Medicare Beneficiaries Is Complex.

Despite reports of a physician burnout epidemic, there is little research on the relationship between burnout and objective measures of care outcomes and no research on the relationship between burnout and costs of care. Linking survey data from 1,064 family physicians to Medicare claims, we found no consistent statistically significant relationship between seven categories of self-reported burnout and measures of ambulatory care-sensitive admissions, ambulatory care-sensitive emergency department visits, readmissions, or costs. The coefficients for ambulatory care-sensitive admissions and readmissions for all burnout levels, compared with never being burned out, were consistently negative (fewer ambulatory care-sensitive admissions and readmissions), suggesting that, counterintuitively, physicians who report burnout may nevertheless be able to create better outcomes for their patients. Even if true, this hypothesis should not indicate that physician burnout is beneficial or that efforts to reduce physician burnout are unimportant. Our findings suggest that the relationship between burnout and outcomes is complex and requires further investigation.

Physicians' Choice of Board Certification Activity Is Unaffected by Baseline Quality of Care: The TRADEMaRQ Study.

PURPOSE: Physicians' use of self-assessment to guide quality improvement or board certification activities often does not correlate with more objective measures, and they may spend valuable time on activities that support their strengths instead of addressing gaps. Our objective was to study whether viewing quality measures, with peer comparisons, would affect the selection of certification activities. METHODS: We conducted a cluster-randomized controlled trial-the Trial of Data Exchange for Maintenance of certification and Raising Quality (TRADEMaRQ)-with 4 partner organizations during 2015-2017. Physicians were presented their quality data within their online certification portfolios before (intervention) vs after (control) they chose board certification activities. The primary outcome was whether the selected activity addressed a quality gap (a quality area in which the physician scored below the mean for the study population). RESULTS: Of 2,570 invited physicians, 254 physicians completed the study: 130 in the intervention group and 124 in the control group. Nearly one-fifth of participating physicians did not complete any certification activities during the study. A sizable minority of those in the intervention group, 18.4%, never reviewed their quality dashboard. Overall, just 27.2% of completed certification activities addressed a quality gap, and there was no significant difference in this outcome in the intervention group vs the control group in either bivariate or adjusted analyses (odds ratio = 1.28; 95% CI, 0.90-1.82). CONCLUSIONS: Physicians did not use quality performance data in choosing certification activities. Certification boards are being pressed to make their programs relevant to practice, less burdensome, and supportive of quality improvement in alignment with value-based payment models. Using practice data to drive certification choices would meet these goals.

Racial/Ethnic Group Trajectory Differences in Exam Performance Among US Family Medicine Residents.

BACKGROUND AND OBJECTIVES: Racial/ethnic score disparities on standardized tests are well documented. Such differences on the American Board of Family Medicine (ABFM) certification examination have not been previously reported. If such differences exist, it could be due to differences in knowledge at the beginning of residency or due to variations in the rate of knowledge acquisition during residency. Our objective was to examine the residents' mean initial scores and score trajectories using the In-Training Examination (ITE) and certification examination. METHODS: A total of 17,275 certification candidates from 2014 to 2019 were included in this study. Annual ITE scores and certification examination scores are reported on the same scale and serve as the outcome. We conducted multilevel longitudinal regression to determine initial knowledge and growth in knowledge acquisition during residency by race/ethnicity categories. RESULTS: The mean postgraduate year 1 (PGY-1) ITE score was 393.3, with minority residents scoring 16.2 to 36.0 points lower compared to White residents. The mean increase per year in exam performance from PGY-1 ITE to the certification exam was 39.9 points (95% CI, 38.7, 41.1) with additional change among race/ethnicity categories per year of -3.2 to 1.9 points. CONCLUSIONS: This study found that there were initial score disparities across race/ethnicity groups in PGY-1, and these disparities continued at the same rate throughout residency training, suggesting equality in acquisition of knowledge during family medicine residency training but with a persistent gap throughout training.